Source-channel prediction in error resilient video coding

Motion compensated prediction in conventional video coders is based on the encoder reconstruction of the previous frame where motion is estimated so as to minimize the encoder prediction error. Such design paradigms optimize the prediction at the encoder and ignore the effects of packet loss. In this paper, we propose a new prediction framework, which uses the expected decoder reconstruction of past frames for prediction. Moreover, the motion estimation criterion is accordingly modified to minimize the expected decoder prediction error. The approach builds on the recursive optimal per-pixel estimate (ROPE), which ensures accurate estimation of the expected values of decoder quantities. The proposed prediction scheme achieves better error resilience performance than its conventional counterpart.